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Abstract. In this paper we construct and analyse strongly connected sparse directed networks with an 
enhanced propensity for synchronization (PFS). Two types of PFS-enhanced networks are considered: 
(i) an eigenratio minimizing ensemble with non-vanishing complex parts of the spectrum and (ii) a class 
of networks with real spectrum but slightly larger eigenratios than (i). We relate the superior PFSs to 
a strongly skewed out-degree distribution, the density of double links and a hierarchical periphery-core 
organization. Ensembles (i) and (ii) are found to differ in the density of double links and the particular 
organization of the core and the periphery-core linkage. 



PACS. 89.75.-k Complex systems. - 05.45.Xt Synchronization; coupled oscillators, 
and organization of complex systems. 



'.75.Fb Structures 



1 Introduction 

Problems of the synchronization of coupled oscillators oc- 
cur in various contexts. Relevant applications are found in 
ecology, neuroscience, biology and engineering, but also in 
the social sciences, e.g., in problems of consensus forma- 
tion. A recent summary of relevant applications can be 
found in pQ. 

Since the realization that the couplings of the individ- 
ual elements in many of the above real-world systems are 
very heterogeneous and differ often markedly from spa- 
tial grids and unstructured random graphs (cf. [SEE]), 
understanding synchronization on complex networks has 
attracted considerable attention in the recent literature. 
A good review of most of the recent developments in the 
field can be found in pQ . One of the important challenges 
is to understand the influence of network structure on the 
dynamics of synchronization. While various studies inves- 
tigate properties of the synchronization transition of non- 
identical Kuramoto oscillators, much insight has also been 
gained by studying the linear stability of the synchroniza- 
tion manifold of identical oscillator systems via the master 
stability function approach [5] . In this work we follow the 
latter approach, employing the general eigenvalue crite- 
rion of [5] to classify a network's propensity for synchro- 
nization (PFS). This eigenvalue criterion is derived from 
a linear stability analysis of the completely synchronized 
state, see below. 

So far, with few exceptions as e.g. [SUZUH] the litera- 
ture has mainly focussed on oscillator systems coupled by 
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undirected networks. Various studies have attempted to 
link network characteristics such as clustering [Ul fTUlfTTl 
rP2] . degree mixing [51ll3|. pathlength 14,15] or between- 
ness centrality jT5l|l 61110] to the PFS. More detailed analy- 
ses, however, show that such a characterization is at most 
meaningful in a statistical sense, since synchronization ap- 
pears to be determined by 'fine' details of the organization 
of the coupling network [17] . Thus, linking synchronization 
properties to statistical network measures often provides 
only a rule of thumb. 

Synchronization on directed networks has been indi- 
rectly addressed via introducing weighing schemes on net- 
works, cf. p^8lfT9ll20] . As main lessons this research shows 
that homogeneity in the in-signals of nodes as well as a 
top-down driven coupling structure, where coupling mainly 
occurs from hub nodes towards non-hub nodes facilitate 
synchronization [19] . However, notwithstanding these many 
results, insights about how the particular arrangement 
of links in directed graphs (with the many more degrees 
of freedom compared to undirected graphs) can influence 
synchronization properties are still rare. 

Thus, in this paper, we address the issue of synchro- 
nization on directed unweighted networks. In this con- 
text Ref. pjj] makes it clear that directed networks with 
optimal PFS are directed trees. Synchronization on di- 
rected trees, however, can hardly be understood as a col- 
lective phenomenon, but is rather a top-down driven pro- 
cess. Moreover, most real- world networks on which syn- 
chronization plays a role are (i) inherently directed and 
(ii) strongly connected or at least have large non-trivial 
strongly connected components. Hence, in this paper we 
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PFSs. The requirement of strong connectedness is also the 
reason why we limit the study to unweighted networks. 

Using a numerical optimization scheme, we describe 
the structure of eigenratio-optimized strongly connected 
directed networks. As such our approach is similar to the 
one of [21j . where optimization is used to study opti- 
mal synchronization on undirected networks. Optimiza- 
tion techniques have already been used to understand the 
organization of complex networks in a variety of other 
contexts, e.g. [22^23,24,25], and we build on this body of 
knowledge here. 

We find that directed strongly connected networks with 
optimal PFS have an hierarchical organization, i.e. they 
are composed of different subsets of nodes. While our find- 
ing that an optimal PFS requires the presence of con- 
nected hub and non-hub nodes and a hierarchical organi- 
zation such that the former predominantly drive the latter 
confirms previous findings [lT?Il2"D] . we also demonstrate 
additional structural requirements related to the details 
of the component organization and the emergence of a 
'super-hub' and its connections to the rest of the network. 
The latter, indeed, is a 'fine' detail of the network organi- 
zation not captured by statistical network properties such 
as pathlengths, motif densities or degree distributions. 

In the following we give a brief description of the gen- 
eral problem and the master stability function approach 
that leads to the eigenratio criterion to define a network's 
PFS. We then motivate the numerical optimization scheme, 
give a brief discussion of the dynamics of Roesler oscilla- 
tors on the optimal networks, and continue with the struc- 
tural analysis of the networks with optimal PFS. The last 
section summarizes and discusses the main results. 



1.1 The MSF Approach 

A general class of synchronization problems can be de- 
scribed in the following way. Consider a system composed 
of N identical oscillators. Without coupling the individual 
dynamics of each oscillator is given by 

Xi = F(xi), (1) 

where x is the state vector in some m dimensional space 
and F gives the individual dynamics of the oscillators 
without coupling. Now assume that the individual oscilla- 
tors are coupled by 

JV 

it = F{xi) + a^A ij {H[x i ] - H[ Xi ]) (2) 
i=i 

JV 

= F(x i ) + aJ2G ij H[x j ] (3) 
i=i 

In Eq. p]l. H is an output function that determines 
which information about the state of i is transmitted to j, 
a the coupling strength and A with Ay = 1 if j is linked 
to i and Ay = otherwise is the adjacency matrix of 

+r,„ „„ i:„„ „„4™™.i, r ri,„ „„„„„J is„„ „f u„ fiol — 



the dynamics by introducing the Laplacian matrix of the 
graph defined by its adjacency matrix A. Since the effec- 
tive coupling matrix G has zero row-sum, a completely 
synchronized state x\(t) = ... = x^{t) = s(t) can exist. 

One then analyzes the linear stability of small pertur- 
bations Sxi around the synchronized state and obtains 

N 

Sxi = DF{s)Sx l + <tDH{s) GijSxj, (4) 

i=i 

with DF(s) and DH(s) being the Jacobian matrices of F 
and H at s. As argued in [5], Eq. ((4|) can be diagonalized 
into N decoupled modes by projecting 5x into the space 
spanned by the eigenvectors of G, yielding 

i lt = [DF(s) - aKDH(s)] m ,l = 1,...,N. (5) 

The eigenmode corresponding to A = describes pertur- 
bations parallel to the synchronization manifold, whereas 
the remaining N— 1 transversal eigenmodes are required to 
decay for the fully synchronized state to be stable. Equa- 
tion ([5]), which is essentially the same for all the non-zero 
modes, defines the master stability function. Introducing 
cii — a\i the evolution of small perturbations r\ is given 
by the largest Lyapunov exponent of the r.h.s. of ([5|), the 
so-called master stability function (MSF) [5] . It has been 
shown that for many oscillator types this eigenvalue is 
smaller than zero only in a limited region of the complex 
plane [26] . 

Let us order the real parts of the eigenvalues of the 
coupling matrix G in the following way — < AJJ < 
••• < AJy. Since the coupling network is strongly con- 
nected we have A£ > 0. Moreover, since the entries of 
G are positive real numbers, complex eigenvalues occur 
in pairs of complex conjugates. Hence, if the stability re- 
gion of ((U is bounded, the eigenratio r = \ r N /\\ and the 
largest magnitude of the complex parts of the eigenval- 
ues c = maxj>i I A* j of G must be small. In this sense, the 
eigenratio r and the maximum spread of the complex parts 
c are measures for a network's PFS. Should the stability 
region of (|5|) be unbounded in the real domain, the eigen- 
ratio r is to be replaced by l/Aj, i.e. configurations with 
maximum A£ realize optimal PFS. Our following analysis 
and comparison between networks PFS's will be based on 
the assumption of a bounded stability region of the MSF, 
i.e. the first criteria. 



1.2 The optimization procedure 

The overall aim of the paper is to construct strongly con- 
nected directed networks with an enhanced PFS by an 
optimization procedure. Generally, we employ the follow- 
ing algorithm, similar to, e.g. [7]: (i) start with a random 
network configuration, (ii) suggest random rewirings that 
leave the number of links constant and do not disconnect 
the strong component and (iii) evaluate the PFS of the 
new configuration as characterized by the eigenration r 
and the maximum absolute value of the complex parts of 

+u„ „;„„ — „i„™ „ i\^„j;c„j „„„c„,. „„„ „„„„„+„j if 
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Fig. 1. Rewiring procedure that leaves the in-degree sequence 
unchanged. 




Fig. 2. Dependence of the extent of the complex part of the 
spectrum c and the eigenratio r of the Laplacian matrix on the 
number of double links in the network. 



they have a PFS superior or equal to the previous config- 
uration and rejected otherwise. The procedure is iterated 
till no improvement in the PFS can be obtained any more 
for a given number of rewiring attempts that is propor- 
tional to the number of links in the network. In the above 
procedure, we generally start by suggesting multiple link 
rcwirings at a time, this 'exploration environment' being 
gradually narrowed down as the optimization progresses. 

In agreement with several studies in the literature [T8l 
19,20,21 preliminary experiments with the above pro- 
cedure demonstrated that homogeneity in the in-signals 
(i.e. in-degree homogeneity) has a predominant influence 
on the eigenratio, without affecting the maximum com- 
plex part c in a systematic fashion. Hence, we developed 
a refined optimization procedure that restricts itself to in- 
degree regular graphs. Rewiring suggestions are arranged 
in the following way which leaves the in-degree sequence 
of the graph unchanged. A node A and one of its out- 
neighbours B are chosen at random. Then, a new out- 
neighbour C for A (which is not A itself and to which A 
is not already connected) is chosen at random, provided 
that the rewiring A — > B to A — > C would not disconnect 
the strong component. The procedure is illustrated in Fig. 



Next, arguments about the spectra of large random 
symmetric/antisymmetric matrices indicate that a posi- 
tive/negative correlation between transposed matrix el- 
ements reduces/enlarges the extent c = maxj>i |AJ-| of 
the complex part of the spectrum [57]. For the special 
case of positive binary coupling networks of interest here 
this suggests a relationship between the link reciprocity 
and the quantity c, i.e. an enhanced number of double 
links reduces the complex part of the spectrum. This is 
not surprising, as one network configuration minimizing 
c are fully bidirectional networks corresponding to sym- 
metric Laplacian matrices which have a real spectrum. In 
fact, experiments constructing networks that minimize c 
for the Laplacian matrix of the coupling network show 
that symmetric coupling proves to be the attractor of the 
optimization in all cases (data not shown). Minimizing r 
for configurations with c = then reproduces the known 
results for synchrony-optimized networks for undirected 
networks [21] . which the authors termed 'entangled nets'. 
These results, however, do not make use of the additional 
degrees of freedom for network organization that are avail- 
able in directed networks. 

On the other hand, numerical experiments with in- 
degree regular random coupling networks with tuned link 
reciprocities also suggest a strong negative correlation be- 
tween the eigenratio and the link reciprocity. To demon- 
strate this relationship we constructed ensembles of in- 
degree regular networks of iV = 100 nodes with a large 
link density (ki n ) = (&out) = 20 and systematically tuned 
link reciprocity, measured by the normalized number of 
double links Ld- For the parameter range investigated this 
tuning can be achieved without a significant change in the 
diameter and average pathlength of the network. Figure 
[2] gives the dependence of both the quantities r and c on 
the normalized density of double links Ld/Lo, where Lq is 
the number of double links expected in a random directed 
graph. The numerical data exhibit an almost linear de- 
crease in r and a linear increase in c when growing the den- 
sity of double links. A more detailed investigation reveals 
that in fact both the smallest non-trivial real part of any 
eigenvalue A£ and the largest real part of G contribute 
to the dependence of the eigenratio on Ld- That is, while 
A^r systematically decreases with Ld, A£ is found to in- 
crease. Similar relationships between c and r and Ld have 
been obtained for in-degree regular graphs with more/less 
skewed out-degree distributions and the results are also 
robust when the link density is changed. 

The above arguments suggest that a simultaneous max- 
imization of r and minimization of c are not possible. 
In fact, the detailed requirements on r and c are deter- 
mined by the detailed structure of the stability region 
of the MSF. However, even though a simultaneous max- 
imization of r and minimization of c proved impossible, 
network structures with a strongly enhanced PFS can be 
constructed by maximizing r, while requiring c to remain 
bounded. Hence, in the following, we optimize the eigen- 
ratio of the coupling networks, but only accept rewired 
configurations for which the complex part of the spectrum 



4 



Markus Brede: Optimal synchronization on strongly connected directed networks 





0.9 - 




0.8 - 


o 




o 


0.7 - 


o 




6 


0.6 - 








0.5 - 




0.4 - 




0.3 - 



10 




i(r 10° 
iterations 



Fig. 3. Evolution of the normalized eigenratio r/ro and max- 
imum complex part c/co during the optimization. The quan- 
tities r and c are normalized by the ro and Co at iteration 
of the optimization (i.e. by the average values for in-degree 
regular random graphs). The data are obtained from 10 opti- 
mizations of networks of size N = 100 with (fe n ) = (k out ) = 3. 
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Fig. 4. Histogram of numbers of networks constructed with 
eigenratio r (bin size .01). The dashed line gives the minimum 
of the extents of the complex part of the spectrum for each bin, 
the points are connected to guide the eye (y2 scale). We pick 
the two outstanding ensembles for further analysis: (a) net- 
works that minimize the eigenratio (r w 1.17 and c = 1.) and 
(b) networks that minimize c while having a very low eigenratio 
(the group with r w 1.34 and c ~ 0.). 



the MSF is such that minimization of the eigenratio is the 
dominant contributor to the stability of the synchronized 
state. 

Figure [3] shows the evolution of r and c in the course 
of such an optimization. Two observations stand out: (i) 
even though r and c are not simultaneously minimized, the 
eigenratio r can be minimized while c remains bounded 
and in fact also decreases by roughly one third and (ii) a 
very substantial reduction of r in comparison to the undi- 
rected optimum configuration (i.e. 'entangled networks') 
is possible. In the following section we proceed by analyz- 
ing the networks with an enhanced PFS obtained in this 
way. 



2 Results 

For the following analysis about 3000 sparse directed net- 
works of size N = 100 with (L) — 300 links have been op- 
timized for an enhanced PFS according to the procedure 
outlined in the previous section. It turns out that the 'fit- 
ness' landscape defined by the networks' PFS is riddled by 
many separate 'deep' basins of attractions, such that the 
optimization frequently gets stuck in local optima. Figure 
[U which gives a histogram for the eigenratios of the con- 
structed networks gives an overview over the optimization 
results. While the left y-axis (impulses) shows the num- 
bers of networks that could be constructed with a certain 
eigenratio, the opposite y-axis (solid squares connected by 
a dashed line) indicates the minimum extent of the com- 
plex part of the spectra over all networks with the same 
eigenratio. Analyzing the data displayed in Fig. 3] two en- 
sembles of networks stand out: (a) The configurations for 

„.r,;„u „;„ „„„ „t,+ „;„„j („ ~ 1 1 1\ 



We consider the subset of networks which have the small- 
est extent of the complex part of the spectrum in this 
group, i.e. c = 1.0. In the following we refer to this group 
as r-optimized networks, (b) The configurations for which 
the spectrum is real (c « 0). We consider the subset of 
networks with the smallest eigenratio in this group, i.e. 
configurations for which r w 1.34. In the remainder of the 
paper this ensemble is referred to as r/c-optimized net- 
works. Ensemble (a) is of interest because it represents the 
network with optimal PFS if the extent of the real domain 
of the stability region of ([5]) is the dominant consideration. 
Ensemble (b) represents networks with optimal PFS in all 
cases where both the real and the complex part have to 
be taken into consideration. The number of evolved PFS- 
enhanced network was chosen such that in both groups, 
the r- and r/c-optimized ensembles, 100 networks could 
be obtained. 

Albeit not reported in detail here, we have also evolved 
optimal sparse networks of different connectivities and 
sizes. It is important to note that the results described 
below were found to be essentially robust in all examined 
situations, i.e. we always found a structurally similar r- 
optimal ensemble of networks minimizing r (but having 
distinctly non-zero c) and an r/c-optimal ensemble mini- 
mizing c (but having a value of r distinctly inferior to the 
r-optimal ensemble). 

2.1 Dynamics 

Before proceeding with an analysis of the evolved net- 
works, we pause to demonstrate that the above procedure, 
which is based on an investigation of the linear regime 
close to the fully synchronized state, does indeed result 
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can be achieved. Even though the linear stability analysis 
of subsection 11.11 strictly applies only for systems of iden- 
tical oscillators, similar to, e.g., [20], we find the PSF to 
be a good indicator of a 'synchronizability' for systems of 
non-identical oscillators as well. 

As an example system for Eq. ^ let us consider a sys- 
tem of coupled Roesler oscillators with coordinates (xi, yi,zi) 
for which 



-uj l y l - z l 
F(xi) = | uJiXi + 0.165?/; 

0.2 + Zi (xi - 10) 



(0) 



Let the inner coupling be realized by the function H(x) = 
x and let the natural frequencies uji be drawn from a uni- 
form distribution over the interval [0.98, 1.02]. 

To proceed, we have numerically integrated Eq. ([2]) for 
the above system using a 4th order Runge-Kutta method. 
Phase synchronization in this system can be measured by 
an order parameter 



r^(*) = l/JV^exp(i^(t)), 

3 

where the phases can be defined via 

<j)j(t) = a,rctan(yj{t)/xj(t)). 
On the other hand, 



(7) 



(8) 



5 x {t) = 1/ViVx 



1/2 



i 



{x ] -{x)f + {y ] -{y)f + {z ] -{)Y 



(9) 
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Fig. 5. Dependence of the order parameters r$ (top) and rs 
(bottom) on the coupling strength. The figure compares the 
synchronization transition for N = 100 Roesler oscillators cou- 
pled by the optimized networks (full circles) and by random in- 
degree homogeneous networks of the same connectivity (open 
circles). Note the different ranges of coupling strengths and the 
logarithmic y-scale at the bottom figure. 



with (x) = 1/NJ2. Xj , (y) = l/iV£. y J: and (z) = 
is a measure for the synchronization error. To obtain val- 
ues between zero and one we further normalize S x (t) by its 
maximum value and introduce rs(t) = l — S(t)/d max . Aver- 
aging r^(t) and rg(t) over a suitable interval of time after 
relaxation, over different randomly assigned choices of na- 
tive frequencies u>i and over the optimized networks gen- 
erated via optimizing the PSF as described above leaves 
us with two order parameters for synchronization, i.e. 
for phase synchronization and r$ for the desynchroniza- 
tion error. In both cases we have r = if the oscillators 
are desynchronized and r = 1 when they are fully syn- 
chronized. 

By plotting the dependence of and rg on the cou- 
pling strength Figure [5] compares the synchronization be- 
haviour of random in-degree homogenous networks and 
PSF-optimized network ensembles. The latter clearly dis- 
play an earlier transition to phase synchronization, but 
also a generally lower desynchronization error, support- 
ing the point that the linear analysis is to some degree 



2.2 Out-degree variance, pathlengths and motif 
densities 

Before investigating the ensembles (a) and (b) separately 
in more detail, it is worth noting that both network en- 
sembles are marked by very strong out-degree heterogene- 
ity and have similar out-degree distributions, cf. Fig. [5] In 
fact, the statistics for the out-degree distributions indicate 
that the evolved networks essentially consist of a group of 
periphery nodes (which are mostly leaves or have very 
small degree) and a set of hub nodes that form the core of 
the network. Gaps in the out-degree hint to a hierarchi- 
cal organization of the hub-nodes. Closer inspection shows 
that a typical optimized network comprises one 'super- 
hub', marked by a distinctly larger out-degree than all 
other nodes. Three to four further hubs with out-degrees 
corresponding to further maxima of the out-degree dis- 
tribution can be distinguished, such that the core of the 
networks typically consists of four to five nodes. More for- 
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Fig. 6. Degree distributions of the optimized networks (groups 
(a) and (b) combined). 



{*|fcout(*) > k} (and the set of links connecting nodes of 
the core) and the periphery by Pu — {i\k out (i) < k} (and 
the set of links connecting periphery nodes). Analyzing 
the out-degree distribution a cut-off of k = 5 appears a 
sensible choice [30] . 

Proceeding in our analysis, we next analyzed frequency 
counts of motifs for the network ensembles. The motif 
counts thus obtained are compared to random expecta- 
tions, which are calculated from randomized network en- 
sembles with the same degree distributions as the original 
ensembles. Most prominently, statistically significant dif- 
ferences in the densities of double links are found, cf. the 
summary of network statistics in Tab.[T] As expected from 
the argument explained in subsection I1.2I there are only 
very few double links in the r-optimized networks. In con- 
trast, the r/c-optimizcd networks show a slightly increased 
density of double links. In fact, experimentally perturbing 
the structure of the optimized networks by artificially in- 
creasing/decreasing the number and location of the double 
links proves that their number and arrangement are sig- 
nificant contributors to the enhanced PFSs. For instance, 
rewiring an r-optimal network such that only one double 
link between periphery nodes is added, typically reduces 
the eigenration to about the mean value of the ensemble 
of in-degree regular random graphs. 

In all evolved networks the double links are found to be 
connected to at least one core node. Occasionally occuring 
double links for r-optimized networks typically connect 
core nodes (excluding the super- hub) , while double links in 
the r/c-optimized networks either establish links between 
core nodes or links between a periphery node and a core 
node. However, comparing randomized networks which 
obey these placement constraints (r = 2.49, c = 1.16) and 
such that do not (r = 2.53, c = 1.19) suggests that the ex- 



the difference in the PFS of the evolved and networks and 
random networks. 

An analysis of various triangle counts and higher order 
motifs also showed no statistically significant differences 
to random networks with the same in- and out-degree dis- 
tributions. This finding is in itself of interest, as some pre- 
vious studies have hinted to the existence of a correlation 
between the synchronizability of a motif and its frequency 
count in several real world networks 28,25]. One may thus 
surmise that such enhanced densities of more synchroniz- 
able motifs also hints to an enhanced PFS of the system 
as a whole. Together with an argument advanced in [5] 
our finding here, that optimized networks do not appear 
to have larger than random densities of any motif apart 
from double links, falsifies this hypothesis. 

An analysis of the distance statistics of the constructed 
networks shows that they are considerably larger than 
the in-degree homogeneous random network with which 
we seeded the optimization, but also considerably smaller 
than randomized networks with the same in- and out- 
degree distributions than the constructed networks, see 
Tab. [T] which summarizes various network statistics. The 
effect is much reduced for the r/c-optimal networks, which 
suggests that the differences in distance is caused by the 
different densities of double links. 

Altogether, the analysis of the standard network prop- 
erties suggests that (i) the out-degree variance is a strong 
predictor of the PFS and (ii) that the density of dou- 
ble links systematically relates to the PFS. Both network 
characteristics, however, are in themselves not sufficient 
to explain the enhanced PFS of the evolved networks. 



2.3 Organization of the cores 

In the following section we analyze the organization of the 
cores Ck, k = 5, of the optimized networks. These are then 
compared to randomized networks with the same degree 
distribution, i.e. the same size of the core. For k = 5 the 
average size of the core is |Ps| = 4.8, i.e. typically only 
about five nodes have an out-degree larger than k — 5. 

To elicit the structure of the core, the following quanti- 
ties are of interest. First, the average number of core-links 
L(Pk) characterizes the cohesiveness of the core. Next, the 
maximum out-component 



Gmax I 
, out I 



max |C out (i) 



(10) 



where C ou t(i) gives the maximum set of core nodes that 
can be influenced by i, decides whether the whole core can 
in principle be directed by one core node. This information 
is refined by calculating the maximum size of the strong 
component 



\SCC(P k )\ = max | SCC (i) |, 



(11) 



a measure for the mutual influence between core nodes. 
A more detailed investigation of individual core arrange- 
ments suggests to also define a quantity |C mo |, the av- 
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Table 1. Overview about properties of PFS-optimized graphs (N — 100, L — 300) 



ensemble 


<r> 


(c) 




<£d> 




(0 


(^max) 


undirected regular random 


27.3 


0.0 


0.0 


150.0 




4.84 


8.8 


undirected, 'entangled' 


12.5 


0.0 


0.0 


150.0 




4.44 


7.0 


in-degree regular random 


3.47 


1.67 


2.4 


4.5 ± 


.3 


4.0 


8.4 


r-optimal directed 


1.17 


1.00 


118. 


1.1 ± 


.2 


6.2 


13.9 


r/c-optimal directed 


1.34 


0.0 


in A 


6.0 




8.8 


19.3 


r-opt., randomized 


2.37 


1.25 


118. 


4.6 ± 


.6 


9.5 


23.6 


r/c-opt., randomized 


2.39 


1.25 


117.0 


4.8 ± 


.5 


9.6 


24.3 


r-opt., randomized, cd 


2.18 


1.56 


118. 


1.1 ± 


.2 


8.6 


22.2 


r/c-opt., randomized, cd 


2.53 


1.19 


117.0 


6.0 




9.9 


24.9 



Table 2. Analysis of the cores 



ensemble 


\SCC(P k )\ 




| Cmo | 


L(P k ) 


r-opt. 


2.4 


4.8 


l.l 


8.7 


r-opt. (r) 


2.6 


4.8 


2.5 


7.2 


r/c-opt. 


3.7 


4.8 


3.3 


10.2 


r/c-opt. (r) 


3.0 


4.8 


3.0 


8.0 



out-component. The relevant statistics for the cores of the 
optimized network ensembles and their randomized coun- 
terparts are detailed in Tab. O 

2.3.1 r-optimized networks 

Cores of the r-optimal network ensembles are found to 
be more densely linked than the randomized ensembles. 
However, the arrangement of links is different from ran- 
dom. Even though the maximum in-component comprises 
the whole core, a unique node, the 'super- hub', that in- 
fluences all other nodes in the core is found. This node 
is not influenced by any other node within the core, i.e. 
I Cmo | ~ 1- The strong component within the core is never- 
theless almost equal to that of the randomized ensemble, 
and is typically comprised of the hubs of intermediate out- 
degree 20 < fc out < 70, cf. also Fig. [6] 

It is interesting to note that the constraint of strong 
connectivity does not lead to an optimal network organi- 
zation that is comprised of a strongly in itself intercon- 
nected core with minimized input from the periphery in 
this case, but rather to an organization that is controlled 
by a single super-hub, which receives all its input from 
the periphery. As we will see below, this input stems from 
the most distant nodes which distinguishes the super-hub 
from the other core nodes. They, in turn, receive all their 
input from other core nodes or nodes belonging to a gen- 
eralized core. 



2.3.2 r/c-optimized networks 

The organization of the components within the r/c-opt 

;„ „„„ — +;„iu, j:flF„„„„+ r„„™ +r,„„„ „r „ , — ^: 




Fig. 7. Illustration of the definition of core sets for an example 
network, cf. text. 



networks. Cores of r/c-optimized networks typically com- 
prise a relatively large strong component, which also in- 
cludes the super-hub. These nodes within the strong com- 
ponent are strongly interlinked, which contributes to the 
substantially larger than random link density in the cores. 
Closer inspection shows that the strong component mostly 
contains only the largest out-degree hub nodes, thus leav- 
ing one or two core nodes with relatively low out-degree 
without input into it. The statistics of periphery nodes in- 
fluencing core nodes is also essentially different from that 
of the r-optimized networks. As explained in more detail 
below, the largest out-degree hubs (and thus the nodes 
in the strong component of the core) receive input from 
nodes that belong to the extended core, rather than from 
nodes in a greater distance as for the case of the r-optimal 
networks. 



2.4 Hierarchies 

A detailed investigation of many individual optimized net- 
works suggests that these networks are distinguished by a 
hierarchical organization of nodes according to the 'qual- 
ity' of the in-signals they receive. To capture this organi- 
sation, we define a hierarchy of core sets Sd in a recursive 

c j„c;j-;, — c _ d ti i„+ o _ u„ „„„, — :„„J 
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of all nodes that receive input only from lower level core 
sets, i.e. from nodes of the set Uf =1 5j. The core cluster 
Smax — UiSj is the set of nodes that can be reached that 
way. All nodes in the core cluster 5 max are uniquely as- 
signed to one set, say Sd, and are thus assigned a well- 
defined value of a core distance d. The maximum core 
distance defines the core diameter rf max and the average 
core distance is obtained from 



(d) = l/|S max | ]T i\Si 



(12) 



An illustration of the concept is provided in Fig. [71 For 
the in-degree regular network displayed in the figure the 
core So is defined by C3, all nodes with out-degree larger 
are equal to three. Nodes in S\ then exclusively get input 
from nodes in So , nodes in Si get some input from So , but 
also from Si , etc. In the example the core cluster comprises 
the whole network and the core diameter is three. 

It is important to note that nodes at a level Sd cannot 
influence nodes of lower levels Si, < 1 < d. However, 
nodes from every level can have input into the core So 
and in fact some of them must have input into the core to 
meet the constraint of strong connectivity for the overall 
network. 

The interpretation of these core sets as a hierarchy 
of nodes with different qualities of input information is 
close at hand. Since more than half of the links in the 
network starts from core nodes Pk, one can argue that 
the network is predominantly driven by those nodes, such 
that the state variables of the core nodes will be closest to 
the synchronization manifold. States of nodes that receive 
input by core nodes without being perturbed by influences 
of other nodes will be the next closest, etc. 

Measuring the core-set and core-distance charcteristics 
of the evolved networks reveals their hierarchical organiza- 
tion. For r-optimized networks one finds ISmaxI = 99.5±1. 
and for r/c-optimized networks l^maxl = 95.7 ± 2. These 
values compare to ISmaxI = 85.3 ±3. and l^max! = 84. ±3. 
for the respective randomized ensembles, i.e. in the op- 
timized networks almost all nodes are part of the core 
cluster and are substantially larger than the expectations. 

More interestingly, notwithstanding the larger core clus- 
ters, the average core distances of the evolved networks 
are substantially smaller than the random expectations. 
For the r-optimized networks one obtains (d) = 2.6 ± .2 
(random expectation (d) = 5. ± .5). Similarly one has 
(d) = 3.4 ± .2 for the r/c-optimized networks (random ex- 
pectation (d) — 5.1 ± .6). Smaller average core-distances 
also translate into smaller core-diameters, i.e. (d max ) = 
11.8 ± 1 vs. (d max ) = 22.3 ± 2 and (d max ) = 17. ± 1 vs. 
(rfmax) = 24.3 ± 2 for the respective ensembles. These dif- 
ferences in the core-distances are substantially larger than 
the differences in the average pathlengths and diameters, 
cf. Tab. Q] and suggest that the optimized networks opti- 
mize the quality of the input information, whereas avg. 
pathlengths and diameter can remain relatively large. In 
fact, a more detailed investigation shows that the large av- 



mainly arise from distances between pairs of periphery 
nodes, which constitute the bulk of the network. 

Further interesting information about the network or- 
ganization can be obtained from an analysis of the core 
distance of nodes that have input into the core and the 
periphery. Figure [8] details the dependence of the aver- 
age core distance of non-core nodes that have input into 
a node on the node's out-degree, i.e. 



d ia (i) = 



J2jeP k A ji d (j) 



(13) 



provided the node i receives any input from nodes other 
than the core. The data are normalized by the average 
non-core input do and compared to the expectation cal- 
culated by an evaluation of randomized networks. Hence 
ratios d- m / do < 1 indicate input of nodes close to the core 
and d- m /do > 1 input of nodes far away from the core. 

We start with the analysis of the r-optimized networks. 
Whereas the expectation essentially shows no dependence 
of a node's non-core input on its out-degree a clear pattern 
is revealed for the optimized networks. The outstanding 
observation from Fig. [8] is that the super-hubs, which as 
we have seen in the previous section receive only input 
from the periphery, receive this input from the periphery 
nodes with the largest core distance. In contrast, other 
core nodes typically receive input only from such non-core 
nodes that are already very close to the core, i.e. essen- 
tially from nodes belonging to S\. In this sense one can 
consider the core nodes and the nodes in Si as a tightly 
interlinked extended core. 

The organization of the cores of the r/c-optimal net- 
works is again different. Here, particularly high-degree 
core nodes receive input from nodes in the core set Si, 
thus again constituting an extended core. Feedback from 
the periphery to the core occurs via the lowly connected 
(and thus lower degree) core nodes. However, common to 
both network organizations is a tighly packed formation 
of a hierarchy of extended cores driven by a tightly in- 
terlinked core in the centre, which then gradually loses 
coherence as it extends towards the periphery. 



3 Conclusions 

Trying to fill the gap in knowledge about synchronization 
properties of directed graphs we have constructed and an- 
alyzed synchrony-optimized strongly connected directed 
in-degree regular networks. In our analysis a network's 
PFS is evaluated on the basis of the eigenvalue criterion 
derived in [5]. The choice of in-degree regular ensembles 
is motivated by the established result that heterogeneity 
in the in-signals is a main contributor to a network's PFS 
and also by the fact that many real-world networks have 
a relatively narrow in-degree distribution. The constraint 
of strong connectivity was introduced because (i) optimal 
PFS in directed networks occurs on trees, i.e. structures 
where one node drives the rest of the network and there 
is no feed-back and (ii) most directed real-world networks 
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such sets reveals the existence of a hierarchy of extended 
cores in the optimal networks. These core sets have also 
been found to be in a tighly packed arrangement char- 
acterized by a small core distance. Feedback from the pe- 
riphery to the core predominantly occurs from nodes in the 
core sets very close to the out-degree hubs. An exception 
to this rule is the super-hub in the r-optimal ensembles. 

A main distinction between the ensembles is the den- 
sity of double links. Whereas double links are strongly sup- 
pressed in the r-optimal ensemble, they are overexpressed, 
and this particularly in the core, in the r/c-optimal ensem- 
ble. While the optimized networks were not distinguished 
by a more than randomly expected expression ratio of any 
higher order motif, the frequency and arrangement of dou- 
ble links was identified as an important contributor to the 
PFS. Double links were strongly suppressed in the periph- 
ery, but were found to frequently link core nodes in the 
r/c-optimal ensemble. 
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Fig. 8. Dependence of the avgerage level distance of inputs 
into a node on the node's out-degree for r-optimized networks 
(top) and r/c-optimized networks (bottom). 



We argued that two ensembles of networks are rele- 
vant: (i) an ensemble of r-optimal networks that mini- 
mize the eigenratio but have a non-vanishing extent of 
the complex part of the spectrum and (ii) an ensemble of 
r/c-optimal networks whose spectra are essentially real, 
but which have a distinctly larger eigenratio than the r- 
optimal ensemble. 

Common to both ensembles of PFS optimal networks 
is the expressed skewness of the out-degree distribution, 
which results in a typical periphery core structure. To fur- 
ther quantify the pecularities of the optimal networks we 
introduced core sets by starting from the core of high out- 
degree nodes and then recursively defining sets of nodes 
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